Crossover behaviour of a one dimensional Random Energy Model. 
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In this note we formulate a finite dimensional generalization of the Random Energy Model (REM) 
where we introduce a geometry and spatial correlations between energies. We study the model in 
dimension one by transfer matrix techniques and we look at the crossover from one dimensional to 
mean-field behaviour. In a first version of the model the mean field limit reproduces the behaviour 
of the original REM, while a second version of the model exhibits a first order phase transition with 
a finite latent heat. 



In the standard REM one considers a system of 2 N lev- 
els with energies which are random independent variables 
extracted from a Gaussian distribution 



The Random Energy Model (REM) |]J2| is a very sim- 
ple mean field spin glass model, that can be exactly 
solved. The model, in spite of its extreme simplicity, 
captures many features of other, more complicated, spin 
glass models. The REM belongs to the class of spin 
glasses which present a phase transition basically due to 
an entropy collapse phenomenon. In other words, at low 
enough temperature, the system finds no states with en- 
ergies below a given value and remains stuck in the lowest 
state. Below a critical value of the temperature the model 
therefore freezes into a state of minimal energy and zero 
entropy. This transition is rather peculiar: even though 
it involves no latent heat, it does not show any precur- 
sor effect (no divergent susceptibility), sharing therefore 
some features typical of first order transitions and others 
typical of second order ones. This behaviour is qualita- 
tively common to a whole class of mean field models of 
spin glasses (e.g. the p > 2-spin model [^[^], the Potts 
model) |p| which show a discontinuous one-step replica 
symmetry breaking transition (IRSB) JtJ. An interesting 
observation is that models of this class seem to be a good 
paradigm to describe structural glasses where no disorder 
is explicitly present in the Hamiltonian but there is an ef- 
fective, self-induced, randomness p|-|lC|]. The aim of this 
work is to provide some insight on what happens to these 
models when considered in finite dimension. Some work 
on this line of research has been contemporarily done on 
a short ranged p-spin glass model above the lower critical 
dimension fll|-|l3[| . In this note we shall introduce a finite 
dimensional generalization of the REM which includes a 
spatial dependence of the variables. We will study in de- 
tail the properties of the model in one dimension where 
no phase transition occurs. Nevertheless the model is de- 
fined in such a way that, in the limit of a parameter M 
to infinity, the mean field solution is recovered. So we 
will observe the crossover towards mean field behaviour 
as M is increased. 

The model will be formulated in two versions, which 
have an interestingly different behaviour. 



P(E) ~ exp(-E 2 /N). 



(1) 



The energy levels of the system can be thought as cor- 
respondent to the configurations of N Ising spins. 

Note that we have not specified any microscopic vari- 
able for this model. This is the natural consequence of 
the hypothesis that in this model the energies are to- 
tally uncorrelated from the microscopical configurations 
which are now only labels of the energy level and are here 
indicated by the index i. 

Usually the limit N — > oo is considered, where the 
system freezes into a state of zero entropy. This is easily 
seen by the following argument. The average number of 
configurations with total energy between E and (E + SE) 



i(E) = 2 



(2) 



where the bar indicates the average over P(E). In the 
large- N limit, for \E\ > E — A?Vln2, the entropy of the 
system is 



In 



(n(E) 



For energies such that \E\ > Eq the exponent becomes 
negative and for large N there are no energy levels. In 
this case the system is frozen into its ground state with 
zero entropy. Introducing the temperature by 

and inverting this relation one obtains the free-energy 



F 



-N (Tln2 + for T > T c 



2Vln2 



for T <T r 



(3) 
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At the critical temperature the saddle point solution 
changes discontinuously and one would say that the tran- 
sition is first order. Furthermore, there are no physical 
quantities that diverge at T c . Nevertheless the free en- 
ergy is differentiable at the critical temperature and no 
latent heat is involved in the transition. 

In the following we shall try to learn if the features of 
this peculiar transition are a property of the adimcnsional 
case and how this transition appear when the model is 
generalized to finite dimension. 

The REM can be generalized by introducing a geome- 
try and a spatial correlation between the energy levels. 

The Dimensional Random Energy Model (DREM) can 
be formulated in general dimension and the mean field 
solution can be found using analytical arguments. For 
finite M we analyze the model in d = 1 by transfer matrix 
techniques and study the crossover from one dimensional 
to mean-field behaviour. 

The DREM will be formulated in two versions, which 
have quite different mean field limit. An interesting ques- 
tion is whether a growing correlation length develops or 
not for increasing M. 

A first version of the model shows, in the large-M limit, 
a transition with no latent heat similar to the case of the 
REM. A second version of the model exhibits a first order 
phase transition into a crystalline state with a disconti- 
nuity in the specific heat. 

The model is defined in the following way: we consider 
a d-dimensional square lattice of side L with M spins on 
each site, in the limit of L — > oo. So V = L d is the 
number of sites and MV is the total number of spins of 
the model. 

Let us consider the link [i — » i + /t) between site i and 
a nearest-neighbour site i + jl where ji is a positive unit 
lattice vector. 

To each of the 2 2M possible configurations of the spins 
at the edges of the link i — > i + jl we associate a random 
energy extracted from the probability distribution 



P(E(a,r)) = 



1 



: exp 



M 



(4) 



The possible energy levels of a link are therefore 2 2M 
independent numbers extracted from a Gaussian distri- 
bution. The partition function of the model is 



Z = eX P ~P^2Y1 E i,i+P-( S i' S i+P-) 



(5) 



Ei t i + p_(si, Si+/i) being the energy of link i — > i + jl. Note 
that, to avoid double counting, we for each site i we con- 
sider only the d nearest neighbours taken along the pos- 
itive versus of each direction. A possible version of the 
model consists in taking the energies of different links as 
independent variables, in which case we have a non trans- 
lational (NTI) invariant spin glass. This is very similar 



to the short range p-spin model introduced in ]1 1| — 11 3|] 
in the large-p limit, where the energies are uncorrelated. 
The only difference, which should not be very important, 
is that this model does not account for the interactions 
between spins which are on the same site. A second pos- 
sible version is a translational invariant (TI) model ^, 
in which the correspondence between the spin configu- 
rations and the possible energy levels is space indepen- 
dent. This means that for each sample one assigns a law 
(a, t) — ► E(a, t) extracting the values of the energy from 

Both versions of the model can be formulated in a sym- 
metric and non-symmetric way i. e. one can impose or not 
impose the following symmetry condition which reduces 
by half the number of independent energy levels 



Ei,i+p. (f) t) — Ei t i + jx (r, a) . 



(6) 



In the following we will study in detail the NTI and the 
symmetric translationally invariant model (STI). While 
the first model is rather natural in a spin glass context, 
the second is more attractive in connection to the mod- 
eling of structural glasses. In this latter model, in fact, 
if the lattice is chessboard decomposable, the system has 
a crystalline ground state. Nevertheless, frustration due 
to the presence of the disorder, makes the minimization 
of the (free) energy a hard task, and the system may 
eventually fall in a glassy state. 

Both versions of the model can be easily solved in the 
large-M limit. This is quite trivial in the case of the 
non-translationally invariant (NTI) DREM since one ba- 
sically recovers the REM. This is clear because for large 
M one can consider the energies of the links essentially 
as uncorrelated so the average number of configurations 
with total energy between E and (E + 5E) is 



n(E) = 2 



(7) 



Applying Derrida's standard microcanonical argument 
on the total energy of the system one obtains a critical 
temperature of T c — l/(2Vm2) and a ground state total 
energy Eq = — MVVln2. This is evidently the mean field 
solution of the model since, for large M, each spin inter- 
acts with a large number of nearest-neighbours. The high 
temperature free energy density of the model is therefore 
the same as that of the REM and at T c the model freezes 
into its ground state. 

The translational invariant model behaves quite dif- 
ferently even at mean field level if formulated with the 
further condition of symmetry . 



*If d > 1 the model would have to be also rotationally in- 
variant for our following consideration to be true. With the 
"TI" we will therefore mean also rotational invariant if d > 1. 
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The STI-DREM has, in fact, a state of lower energy 
than — jl4X\An2. This can be understood by consider- 
ing the possible energy levels of one single link. The set 
of the energies of each single link is a REM with 2 2M 
energy levels and has therefore a ground state energy 



where t\ and t<i are respectively the first and second 
largest (in modulus) eigenvalues of T and Ai is called 
maximum Lyapunov exponent . 

In the case of the NTI model one has to consider the 
product of the sequence of L transfer matrices Pl = 



Ei,i+p,(o~i,T° + p) = — M-\/21n2. This is true also for the Il<=i ^ an< ^ define the correspondent hermitian matrix 
NTI model or for the TI model without the symmetry 

V L = (P L +P L ) . 

For (L — > oo) the free energy density of the model 
can be calculated by making use of some central limit 
theorems for products of random matrices. 

More precisely one can say (Fustemberg theorem) that 
the following limit 



condition, but the choice of the configuration T t ° + ^ on 
site i + p to minimize Ei t i+p,, in general does not allow 
£'i+/l ) i+£+j> to be minimized. Here i + p + is a general 
nearest neighbour site of i+p. The reason for this is that 
if the disorder is different from link to link and there is 
no condition assuring that the ground state of E^+^j+p 
will correspond to the configuration Tf + n on site i + p. 
In fact the TI without the symmetry condition can crys- 
tallize on a periodic state only in those samples having 
Eq = E(a® 7 of + n) so the energy of each link may again 
be in the ground state. For the STI-DREM the picture is 
quite different: if the lattice is chessboard decomposable, 
the spins can always arrange themselves in a structure 
that alternates in space the minimizing configurations 
°i j T i+p,- I n this wav i contrarily to the NTI model, every 
link is in its true ground state. This yields a total energy 
Eq = —MV\ / 2\n2 which is lower than Eq. The freezing 
into this true ground state will happen at a temperature 
T c at which the high temperature free energy reaches the 
value Eq. One has 



T n = 



1 + V2 



(8) 



This transition is first order and the latent heat is 



Clat — 



(9) 



Below the lower critical dimension the phase transition 
disappears when M is finite. We do not know at present 
what the critical dimension is, but we know that it has 
to be larger than one. However, even in dimension one, 
it is interesting to study the crossover from smooth to 
sharp behaviour when M is increased. 

For finite values of M we analyzed the model in one di- 
mension by transfer matrix. For each link i of the model 
we have a 2 M x 2 M transfer matrix Tj. For the transla- 
tionally invariant model one has 

fi = f, 

and it is easy to show, by standard transfer matrix argu- 
ments, that, in the limit of an infinite chain (L — > oo), 
one can calculate the free energy density and the corre- 
lation length by the following identities 

-0F= lim Y ln (*i) = A i, 

L—*00 Li 



In 



(-1) 



(10) 



(3F = Ai 



1- 



lim -ln||P L | 

L — >oo Li 



(11) 



exists with probability one. 

Ai is called maximum Lyapunov characteristic expo- 
nent and is a positive non-random quantity Jl4} |. One 
can define a whole set of characteristic Lyapunov expo- 
nents 



A, 



lim -5-ln(fi), 

L — >oo ALi 



(12) 



where the U are the eigenvalues of Vl- Similarly to the 
TI case a correlation length can then be defined 



(13) 



We computed the first and second Lyapunov charac- 
teristic exponent by means of the method developed by 
Benettin et al. @ . 

The results obtained by transfer matrix for finite M are 
summarized in figure (Q-gj) . The values of the free energy 
per link F(T) are slightly different from the M — > infinity 
values above but one can verify that they are consistent 
with them. For finite M a given sample of the TI model 
is more likely to freeze at higher temperature than the 
mean field value, and the free energy is always well above 
the mean field curve. 

In figure |l]) and (S) we plot the free energy density per 
link of the STI-DREM and of the NTI-DREM in function 
of the temperatures and for different values of M. 

In the first figure we plot the sample-averaged free en- 
ergy, while the second needs no average in virtue of the 
Fustemberg theorem. In figure (Q) the errors are of the 
same order of magnitude of the pointsize. In figure (j^) 
there is a small numerical imprecision which, we reckon, 
is responsible for the slight wiggling of all the curves for 
the NTI case. 

We note that the non-translational invariant models as 
well as the non symmetric translational invariant follow 
quite well the mean field theoretical prediction already 
for quite small M. In figure (|l|) and (0) we also potted 
the lowest energy state for different values of M. The 
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TI model succeeds in freezing right in the lowest energy 

by arranging itself on the configuration of period 2. The 1e+09 

NTI model does not reach its lowest energy state and 1e+ oe 

freezes only at lower temperatures with a higher value of 

the energy. 1e+07 

1e+06 




for M = 4,5, 6, 7. The horizontal lines are the ground state 
energies 
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FIG. 3. Correlation length of the TI d = 1 REM vs tem- 
perature for M = 4,5, 6, 7. 
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FIG. 1. Free energy of the TI d = 1 REM vs temperature 
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FIG. 4. Ferromagnetic correlation length of the of the TI 
d = 1 REM vs temperature for M = 4,5, 6, 7. 
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FIG. 2. Free energy of the NTI d = 1 REM vs temperature 
for M = 4, 5, 6, 7. The horizontal lines are the ground state 
energies. 
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FIG. 5. Correlation length of the NTI d = 1 REM vs tem- 
perature for M — 4,5, 6, 7. 

In figure (||) and (EJ) we plot the correlation lengths of 
the models. 

For the TI model we averaged the logarithm of the 
correlation length for different samples. One notices that 
at T c the curves for various values of M separate consis- 
tently and are steeper and steeper the larger M is. Here 
one sees the effect of the crossover with the mean field 
limit since one could imagine a discontinuity at T c for 
infinite M . For the TI model we also defined a 'ferro- 
magnetic' correlation length by computing 




where tf is the second maximum positive eigenvalue. At 
low temperatures £/ does not coincide with the real £ be- 
cause there is usually a negative eigenvalue than is larger 
in modulus than tf. 

It can be seen that £/ = £ oruv m those samples (that 
occur with frequency 0(1 /M )) in which the ground states 
happens to be on the diagonal of the matrix E(a, r). The 
second eigenvalue for the most of the samples is negative 
because it detects an anti-ferromagnetic ordering. The 
reason of this is that Eq = E(ko,ko) implies that two 
nearby sites tend to be have the same configuration of 
spins in the lowest energy state. The opposite happens 
in the anti-fcrromagnetic case. As it can be seen from 
figure (|j), the ferromagnetic correlation length does not 
diverge at zero temperature but shows a peak, whose 
height grows with M, in correspondence of the transi- 
tion temperature T c . In figure @ we plot the correlation 
length of the non-translationally invariant model. Con- 
sistently with our mean field predictions, the peak, which 
shows the crossover with the mean field behaviour, seems 
to predict the MF critical temperature T c and not T c . So 
this one-dimensional REM can give us a slight idea on 



what happens when the models that in MF present a 
discontinuous 1RSB transition are generalized to finite 
dimension. 

The speculation that one could make from the results 
obtained in this work is the following: if the model is 
provided with an underlying crystalline ground state, the 
transition in finite dimension becomes a real first order 
transition with a finite latent heat; if there is no under- 
lying crystalline state, the transition does not seem to 
show any discontinuity on the first derivative of the free 
energy as a second order transition (for the possibility of 
the arousal of divergent correlations see ]Tl"|-|l3|] ) . 

The numerical exact solution in dimension d — 1 rep- 
resents a complementary approach to what was done in 
|]llf where one started from the MF solution. There is 
still much work that has to be done on the subject. 

We wish to acknowledge useful conversations with 
A. Crisanti and A. Vulpiani. 
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